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frequency  response  data  on  the  individual  cells,  and  robust  in  the  sense  that  they  are  not 
affected  by  unmodelled  parasitic  resistances  and  capacitances  in  the  interconnect  network. 


DTIC 

fcELECTE 
h  FEB  061988 

*  <\ u 


— 


Microsystems 
Research  Center 
Room  39-321 


Massachusetts 
Institute 
of  Technology 


Cambridge 

Massachusetts 

02139 


89 


Telephone 
(617)  253-8138 


009 


Acknowledgements 

To  appear  in  IEEE  Transactions  on  Circuits  and  Systems ,  Special  Issue  on  Neural  Networks, 
1989.  This  research  was  supported  in  part  by  the  Defense  Advanced  Research  Projects 
Agency  under  contract  number  N00014-87-K-0825  and  the  National  Science  Foundation 
under  contract  MIP-8814612. 


Author  Information 

Standley:  Electrical  Engineering  and  Computer  Science,  MIT,  Room  36-863,  Cambridge, 
MA  02139.  (617)  253-2631. 

Wyatt:  Electrical  Engineering  and  Computer  Science,  MIT,  Room  36-864,  Cambridge, 
MA  02139.  (617)  253-6718. 


Copyright*  1988  MIT.  Memos  in  this  series  are  for  use  inside  MIT  and  are  not  considered 
to  be  published  merely  by  virtue  of  appearing  in  this  series.  This  copy  is  for  private 
circulation  only  and  may  not  be  further  copied  or  distributed,  except  for  government 
purposes,  if  the  paper  acknowledges  U.  S.  Government  sponsorship.  References  to  this 
work  should  be  either  to  the  published  version,  if  any,  or  in  the  form  “private 
communication.”  For  information  about  the  ideas  expressed  herein,  contact  the  author 
directly.  For  information  about  this  series,  contact  Microsystems  Research  Center,  Room 
39-321,  MIT,  Cambridge,  MA  02139;  (617)  253-8138. 


To  appear  in  IEEE  Transactions  on 
Circuits  and  Systems,  Special  Issue 
on  Neural  Networks,  1989. 


Stability  Criterion  for  Lateral  Inhibition  and  Related  Networks 
that  is  Robust  in  the  Presence  of  Integrated  Circuit  Parasitics 

D.L.  Standley  and  J.L.  Wyatt,  Jr. 

Department  of  Electrical  Engineering  and  Computer  Science 
Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139 


4 


ABSTRACT 

In  the  analog  VLSI  implementation  of  neural  systems,  it  is  sometimes  con¬ 
venient  to  build  lateral  inhibition  networks  by  using  a  locally  connected 
on-chip  resistive  grid.  A  serious  problem  of  unwanted  spontaneous  oscilla¬ 
tion  often  arises  with  these  circuits  and  renders  them  unusable  in  practice. 
This  paper  reports  a  design  approach  that  guarantees  such  a  system  will 
be  stable,  even  though  the  values  of  designed  elements  in  the  resistive  grid 
may  be  imprecise  and  the  location  and  values  of  parasitic  elements  may  be 
unknown.  The  method  is  based  on  a  mathematical  analysis  using  Telle- 
gen’s  theorem  and  the  Popov  criterion.  The  criteria  are  local  in  the  sense 
that  no  overall  analysis  of  the  interconnected  system  is  required  for  their 
use,  empirical  in  the  sense  that  they  involve  only  measurable  frequency  re¬ 
sponse  data  on  the  individual  cells,  and  robust  in  the  sense  that  they  are 
not  affected  by  unmodelled  parasitic  resistances  and  capacitances  in  the 

interconnect  network.  ,  , 

/ )  ;  - 


I.  Introduction 


The  term  “lateral  inhibition”  first  arose  in  neurophysiology  to  describe  a 
common  form  of  neural  circuitry  in  which  the  output  of  each  neuron  in  some 
population  is  used  to  inhibit  the  response  of  each  of  its  neighbors.  Perhaps 
the  best  understood  example  is  the  horizontal  cell  layer  in  the  vertebrate 
retina,  in  which  lateral  inhibition  simultaneously  enhances  intensity  edges 
and  acts  as  an  automatic  gain  control  to  extend  the  dynamic  range  of  the 
retina  as  a  whole  [1].  The  principle  has  been  used  in  the  design  of  artificial 
neural  system  algorithms  by  Kohonen  [2]  and  others  and  in  the  electronic 
design  of  neural  chips  by  Mahowald  and  Mead  [3,4]. 
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In  the  VLSI  implementation  of  neural  systems,  it  is  convenient  to  build 
lateral  inhibition  networks  by  using  a  locally  connected  on-chip  resistive 
grid.  Linear  resistors  fabricated  in,  e.g.,  polysilicon,  could  yield  a  very 
compact  realization,  and  nonlinear  resistive  grids,  made  from  MOS  transis¬ 
tors,  have  been  found  useful  for  image  segmentation  [4,5].  Networks  of  this 
type  can  be  divided  into  two  classes:  feedback  systems  and  feedforward- 
only  systems.  In  the  feedforward  case  one  set  of  amplifiers  imposes  signal 
voltages  or  currents  on  the  grid  and  another  set  reads  out  the  resulting 
response  for  subsequent  processing,  while  the  same  amplifiers  both  “write 
to”  the  grid  and  “read  from”  it  in  a  feedback  arrangement.  Feedforward 
networks  of  this  type  are  inherently  stable,  but  feedback  networks  need  not 
be. 

A  practical  example  is  one  of  Mahowald  and  Mead’s  retina  chips  [3]  that 
achieves  edge  enhancement  by  means  of  lateral  inhibition  through  a  resistive 
grid  and  temporal  sharpening  by  comparing  the  present  input  with  a  ca- 
pacitively  filtered  version.  Figure  1  shows  a  single  cell  in  a  continuous-time 
version  of  this  chip,  and  Fig.  2  illustrates  the  network  of  interconnected 
cells.  Note  that  the  voltage  on  the  capacitor  in  any  given  cell  is  affected 
both  by  the  local  light  intensity  incident  on  that  cell  and  by  the  capaci¬ 
tor  voltages  on  neighboring  cells  of  identical  design.  Each  cell  drives  its 
neighbors,  which  drive  both  their  distant  neighbors  and  the  original  cell  in 
turn.  Thus  the  necessary  ingredients  for  instability  —  active  elements  and 
signal  feedback  —  are  both  present  in  this  system.  Experiment  has  shown 
that  the  individual  cells  in  this  system  are  open-circuit  stable  and  remain 
stable  when  the  output  of  transamp  #  2  is  connected  to  a  voltage  source 
through  a  resistor,  but  the  interconnected  system  oscillates  so  badly  that 
the  original  design  is  scarcely  usable1  in  practice  [6].  Such  oscillations  can 
readily  occur  in  any  resistive  grid  circuit  with  active  elements  and  feedback, 
even  when  each  individual  cell  is  quite  stable.  Analysis  of  the  conditions  of 
instability  by  conventional  methods  appears  hopeless,  since  the  number  of 
simultaneously  active  feedback  loops  is  enormous. 

This  paper  reports  a  practical  design  approach  that  rigorously  guaran¬ 
tees  these  and  related  systems  will  be  stable  under  certain  conditions.  The 

‘The  later  design  reported  in  [3]  avoids  this  problem  altogether,  at  a  small  cost  in  per¬ 
formance,  by  redesigning  the  circuits  to  passively  sense  the  grid  voltage  in  a  “feedforward” 
style  as  described  above. 
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work  begins  with  the  naive  observation  that  the  system  would  be  stable  if 
we  could  design  each  individual  cell  so  that,  although  internally  active,  it 
acts  like  a  passive  system  as  seen  from  the  resistive  grid.  The  design  goal  in 
that  case  would  be  that  each  cell’s  output  impedance  should  be  a  positive- 
real  (i.e.,  passive)  [7-9]  function.  This  is  sometimes  possible  in  practice:  we 
will  show  that  the  original  network  in  Fig.  1  satisfies  this  condition  in  the 
absence  of  certain  parasitic  elements.  Furthermore,  it  is  a  condition  one 
can  verify  experimentally  by  frequency-response  measurements. 

It  is  obvious  that  a  collection  of  cells  that  appear  passive  at  their  ter¬ 
minals  will  form  a  stable  system  when  interconnected  through  a  passive 
medium  such  as  a  resistive  grid,  and  that  the  stability  of  such  a  system  is 
robust  to  perturbations  by  passive  parasitic  elements  in  the  network.  The 
contribution  of  this  paper  is  to  go  beyond  that  observation  to  provide  i)  a 
demonstration  that  the  passivity  or  positive-real  condition  is  much  stronger 
than  we  actually  need  and  that  weaker  conditions,  more  easily  achieved  in 
practice,  suffice  to  guarantee  robust  stability  of  the  linear  network  model, 
and  ii)  an  extension  of  the  analysis  to  the  nonlinear  domain  that  further¬ 
more  rules  out  sustained  large-signal  oscillations  under  certain  conditions. 

Note  that  these  results  do  not  apply  directly  to  networks  created  by 
interconnecting  neuron-like  elements,  as  conventionally  described  in  the 
literature  on  artificial  neural  systems.  The  “neurons”  in,  e.g.,  a  Hopfield 
network  [10]  are  unilateral  2-port  elements  in  which  the  input  and  output 
are  both  voltage  signals.  The  input  voltage  uniquely  and  instantaneously 
determines  the  output  voltage  of  such  a  neural  model,  but  the  output  can 
only  affect  the  input  via  the  resistive  grid.  In  contrast,  the  cells  in  our  sys¬ 
tem  are  1-port  electrical  elements  (temporarily  ignoring  the  optical  input 
channel)  in  which  the  port  voltage  and  port  current  sure  the  two  relevant 
signals,  and  each  signal  affects  the  other  through  the  cell’s  internal  dynam¬ 
ics  (modelled  as  a  Thevenin  equivalent  impedance)  as  well  as  through  the 
grid’s  response. 


II.  The  Linear  Theory 

This  work  was  motivated  by  the  following  linear  analysis  of  a  model  for  the 
circuit  in  Fig.  1.  For  an  initial  approximation  to  the  output  admittance  of 
the  cell  we  use  the  elementary  model  shown  in  Fig.  3  for  the  amplifiers  and 
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simplify  the  circuit  topology  within  a  single  cell  (without  loss  of  information 
relevant  for  stability)  as  shown  in  Fig.  4. 

Straightforward  calculations  show  that  the  output  admittance  is 

+  +  +  (i) 

This  is  a  positive-real  admittance  that  could  be  realized  by  a  network  of 
the  form  shown  in  Fig.  5,  where 


Rl  —  (<7ma  +  )  i  R]  —  (<7mi  Qm-iRox  )  ,  and  L  —  Co ,  / (/m,  9  mi  ■  (2) 

Of  course  this  model  is  oversimplified,  since  the  circuit  does  oscillate. 
Transistor  parasitics  and  layout  parasitics  cause  the  output  admittance  of 
the  individual  active  cells  to  deviate  from  the  form  given  in  eqs.  (1)  and 
(2),  and  any  very  accurate  model  will  necessarily  be  quite  high  order.  The 
following  theorem  shows  how  far  one  can  relax  the  positive-real  condition 
and  still  guarantee  that  the  entire  network  is  robustly  stable.  Though  we 
have  been  unable  to  find  such  a  theorem  in  the  literature,  the  concepts  used 
in  the  proof  are  well-established  and  this  result  is  not  surprising. 

Terminology 

The  terms  open  Tight-half  plane  and  closed  right-half  plane  refer  to  the  set 
of  all  complex  numbers  s  ■=  cr  +juj  with  <r  >  0  and  a  >  0,  respectively,  and 
the  term  closed  second  quadrant  refers  to  the  set  of  complex  numbers  with 
a  <  0  and  u;  >  0.  A  natural  frequency  of  a  linear  network  is  a  complex 
frequency  s0  such  that,  when  all  independent  sources  are  set  to  zero  and 
all  branch  impedances  and  admittances  are  evaluated  at  s0,  there  exists  a 
nonzero  solution  for  the  complex  branch  voltages  {V*}  and  currents  {/*} 
[11].  For  the  purposes  of  this  section,  a  lumped  linear  network  is  said  to  be 
stable  if  a)  it  has  no  natural  frequencies  in  the  closed  right-half  plane  except 
perhaps  at  the  origin,  and  b)  any  natural  frequency  at  the  origin  results 
only  in  network  solutions  that  are  constant  as  functions  of  time.  (The  latter 
condition  rules  out  unstable  transient  solutions  that  grow  polynomially  in 
time  resulting  from  a  repeated  natural  frequency  at  the  origin.) 
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Theorem  1 

Consider  a  linear  network  of  arbitrary  topology,  consisting  of  any  num¬ 
ber  of  positive  2-terminal  resistors  and  capacitors  and  of  N  lumped  linear 
impedances  Zn(s),n  =  1,2, ...,  JV,  that  are  open-  and  short-circuit  stable  in 
isolation,  i.e.,  that  have  no  poles  or  zeroes  in  the  closed  right  half  plane. 
Then  the  network  is  stable  if  at  each  frequency  u  >  0  there  exists  a  phase 
angle  d(u)  such  that  0  >  9{u)  >  —90°  and  |  LZn(ju)  —  d(ju)\  <  90°,  n  = 
l,2,...,iV. 

An  equivalent  statement  of  this  last  condition  is  that  the  Nyquist  plot 
of  each  cell’s  output  impedance  for  u>  >  0  never  intersects  the  closed  2nd 
quadrant,  and  that  no  two  cells’  output  impedance  phase  angles  can  ever 
differ  by  as  much  as  180°.  If  all  the  active  cells  are  designed  identically  and 
fabricated  on  the  same  chip,  their  phase  angles  should  track  fairly  closely 
in  practice  and  thus  this  second  condition  is  a  natural  one. 

The  theorem  is  intuitively  reasonable.  The  assumptions  guarantee  that 
the  cells  cannot  resonate  with  one  another  at  any  purely  sinusoidal  fre¬ 
quency  s  =  ju)  since  their  phase  angles  can  never  differ  by  as  much  as 
180°,  and  they  can  never  resonate  with  the  resistors  and  capacitors  since 
there  is  no  u  >  0  at  which  both  Re{Zn(ju)}  <  0  and  Im{Zn(ju>)}  >  0 
for  some  n,l  <  n  <  N.  Figure  6  illustrates  these  ideas.  The  proof,  which 
appears  in  the  Appendix,  formalizes  this  argument  using  conservation  of 
complex  power,  extends  it  to  rule  out  natural  frequencies  in  the  right-half 
plane  as  well,  and  shows  why  instabilities  resulting  from  a  repeated  natural 
frequency  at  the  origin  cannot  occur.  Note  that  this  formulation  of  the 
theorem  does  not  guarantee  a  unique  equilibrium,  since  capacitor-only  cut¬ 
sets  are  not  ruled  out.  In  the  absence  of  such  cut-sets  the  equilibrium  will 
be  unique  because  the  d.c.  cell  conductances  Kn(0)  are  strictly  positive. 

III.  Stability  Result  for  Networks  with  Nonlinear  Re¬ 
sistors  and  Capacitors 

The  previous  results  for  linear  networks  can  afford  some  limited  insight 
into  the  behavior  of  nonlinear  networks.  First  the  nonlinear  equations  are 
linearized  about  an  equilibrium  point  and  Theorem  1  is  applied  to  the  linear 
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model.  If  the  linearized  model  is  asymptotically  stable,  then  the  equilibrium 
point  of  the  original  nonlinear  network  is  locally  stable ,  i.e.,  the  network  will 
return  to  that  equilibrium  point  if  the  initial  condition  is  sufficiently  near 
it.  But  the  result  in  this  section,  in  contrast,  applies  to  the  full  nonlinear 
circuit  model  and  allows  one  to  conclude  that  it  cannot  blow  up  or  oscillate 
even  if  the  initial  state  is  arbitrarily  far  from  the  equilibrium  point. 

Terminology 

We  say  that  an  impedance  Z(s)  satisfies  the  Popov  criterion  if  (1  +rs)Z(s) 
is  positive  real  [7,8,9]  for  some  r  >  0.  (Note  that  this  formulation  of  the 
Popov  criterion  differs  slightly  from  that  given  in  standard  references  [8,9].) 

Theorem  2 

Consider  a  network  consisting  of  possibly  nonlinear  resistors  and  capacitors, 
along  with  two-terminal  cells  each  consisting  of  a  linear  impedance  Zn(s ) 
in  series  with  a  d.c.  Thevenin  equivalent  voltage  source  of  value  vjf,  for 
n  =  1,2,  ...,1V.  Assume  the  network  has  an  equilibrium  point  (i.e.,  a  d.c. 
solution)  characterized  by  a  voltage  and  current  i°  for  each  branch  fc,  and 
that  for  any  initial  condition  at  t  —  0,  there  exists  a  unique,  continuously 
differentiable  solution  for  the  branch  voltage  and  current  waveforms  defined 
for  all  <  >  0.  Assume 

i)  the  resistor  curves  are  continuously  differentiable  functions  Vk  = 
fk(ik),  with  the  derivative  /*(»*)  >  Rmin  >  0  for  all  k  and  **, 

ii)  the  capacitors  are  characterized  by  continuous  functions  ik  =  Ck(vk)vk 
where  0  <  Ck(vk)  <  CmaX  for  all  fc  and  Vk,  and 

iii)  the  impedances  Zn(s)  all  satisfy  the  Popov  criterion  for  some  com¬ 
mon  value  of  r  >  0.  Then  the  network  is  stable  in  the  sense  that,  for  any 
initial  condition, 

/  £  (**(<)  -  *'fc)2<ft  +  rj  £  **(*)*  <  °°-  (3) 

0  ail  resiaton  0  all  capacitors 

The  proof,  which  relies  on  interesting  dualities  between  resistor  co¬ 
content  and  capacitor  energy  and  between  resistor  power  and  a  form  of 
capacitor  reactive  power,  is  in  the  Appendix.  Note  that  Thm.  2,  as 
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stated,  does  not  require  the  equilibrium  point  to  be  unique,  since  any  cell 
impedance  may  have  a  (nonrepeated)  pole  at  the  origin  and  cut-sets  com¬ 
posed  entirely  of  capacitors  and/or  such  cells  are  not  ruled  out.  In  the 
absence  of  such  cut-sets  the  equilibrium  will  in  fact  be  unique  for  each 
value  of  the  Thevenin  equivalent  voltage  sources. 

The  Popov  criterion  condition  on  the  cell  impedances  can  be  weakened, 
given  some  simple  topology  and  modeling  restrictions.  In  many  circuits, 
such  as  the  regular  array  in  Fig.  2,  each  cell  has  one  terminal  connected 
only  to  a  fixed  or  limited  number  of  grid  resistors,  never  to  the  terminal  of 
another  cell.  This,  along  with  a  limit  on  the  incremental  conductance  of 
the  resistors,  can  be  used  to  effectively  add  linear  resistors  to  the  terminals 
of  each  cell  impedance,  allowing  the  user  to  shift  the  Nyquist  plots  to  the 
right  before  applying  the  Popov  criterion.  Figure  7  illustrates  this  process 
in  stages,  and  Thm.  3  below  states  the  improvement. 

Theorem  3 

Consider  a  network  satisfying  the  following  conditions  in  addition  to  the 
assumptions  of  Theorem  2: 

i)  the  resistor  curves  have  derivative  /£(**)  >  Rmin  +  e,  Rmin  >  0  for 
some  t  >  0,  for  all  k  and 

ii)  each  cell  (which  includes  the  series  voltage  source  vff)  has  at  least 
one  terminal  connected  to  zero  capacitors,  zero  cells,  and  to  no  more  than 
M  resistors,  and 

iii)  the  impedances  Z„(s)  are  such  that  the  corresponding  expressions 
Zn(s)  +  (Rmin/2M)  all  satisfy  the  Popov  criterion  for  some  common  value 
of  r  >  0.  Then  the  network  is  stable  in  the  sense  that,  for  any  initial 
condition, 

J  £  (h(t)  -  i°k)2dt  +  r  J  53  il(t)dt<  oo.  (4) 

0  ail  reaiator*  0  ail  ca pad  Cor* 

The  proof  is  in  the  Appendix. 
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IV.  Concluding  Remarks 


The  design  criteria  established  by  these  theorems  are  simple  and  practical, 
though  at  present  their  validity  is  restricted  to  linear  models  of  the  cells. 
The  results  are  consistent,  in  an  interesting  way,  with  the  spirit  of  neural 
networks.  Attention  is  focussed  on  the  global  collective  behavior  of  the 
system.  Neither  the  stability  criteria  nor  the  methods  of  proof  rely  on 
assigning  any  specific  functional  role  to  any  particular  component.  This 
feature  is  characteristic  of  Tellegen’s  theorem  and  most,  if  not  all  of,  the 
results  that  follow  from  it  [12]. 

There  are  several  areas  of  further  work  to  be  pursued,  one  of  which 
is  an  analysis  of  the  cell  that  includes  amplifier  clipping  effects.  Others 
include  the  synthesis  of  a  compensator  for  the  cell,  an  extension  of  the 
nonlinear  result  to  include  impedance  multipliers  other  than  the  Popov  op¬ 
erator,  a  waveform  bounding  analysis  of  the  network  which  would  guarantee 
adequate  convergence  after  an  allotted  settling  time,  and  an  input-output 
stability  theorem. 


V.  Appendix 


Proof  of  Theorem  1 


Let  s0  denote  a  natural  frequency  of  the  network  and  {14},  {/*}  denote  any 
complex  network  solution  at  s0.  By  Tellegen’s  theorem  [12],  or  conservation 
of  complex  power,  we  have 


£nc  =  o, 

k 

i.e.,  for  s0  i=-  any  pole  of  Zn,  n  =  1, ...,  N  and  s0  ^  0, 

+  £|/fe|2(s0Cfe)-1  +  T,\In\2Zn(So)  =0 
resistors  capacitors  cell  impedances 

and  for  s0  ^  any  zero  of  Zn,  n  =  1, N, 

mw  +  eiv*p»;c*  +  =« 

resistors  capacitors  cell  admittances 
where  the  superscript  *  denotes  the  complex  conjugate  operation. 


(5) 

(6) 

(7) 
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i)  There  sure  no  natural  frequencies  at  s0  =  ju>  0. 

For  each  u;  >  0  all  the  cell  impedance  values  lie  strictly  below  and  to  the 
right  of  the  half-space  boundary  in  Fig.  6.  The  capacitance  impedances 
{(ju)Ck)~1}  and  the  resistor  impedances  {i?*}  also  lie  below  and  to  the 
right  of  this  line.  Thus  no  positive  linear  combination  of  these  impedances 
can  vanish  as  required  by  eq.  (6).  A  similar  argument  holds  for  u>  <  0. 

ii)  There  are  no  instabilities  resulting  from  a  repeated  natural 
frequency  at  the  origin. 

The  assumptions  that  the  cell  impedances  have  no  jur-axis  zeroes  and  that 
their  Nyquist  plots  for  u  >  0  never  intersect  the  closed  2nd  quadrant  imply 
that  F^(0)  >  0,n  =  1,  ...,  jV.  Thus  eq.  (7)  requires  that  all  the  voltages 
across  resistor  branches  and  cell  output  branches  must  vanish  in  any  com¬ 
plex  network  solution  at  sa  =  0.  Thus  only  the  capacitor  voltages  can 
be  nonzero  and  the  network  solution  will  be  unaltered  if  all  non-capacitor 
branches  are  replaced  by  short  circuits.  But  every  solution  to  a  network 
comprised  only  of  positive,  linear  2-terminal  capacitors  is  constant  in  time 
and  hence  stable. 

iii)  There  are  no  natural  frequencies  in  the  open  right'half  plane. 

Assume  the  contrary,  i.e.,  that  there  exists  such  a  network  with  a  natural 
frequency  30  with  f2e{30}  >  0.  Alter  each  element  in  the  network  (except 
resistors)  as  follows.  For  each  cell  having  a  Zn(s)  of  relative  degree  less 
than  zero,  add  a  series  resistance  f2;  for  all  other  cells  and  for  capacitors, 
add  a  parallel  conductance  G  to  each.  Call  each  resulting  pair  a  “composite 
element”,  and  choose  R  =  G  =  A  >  0.  For  A  sufficiently  large  all  natural 
frequencies  must  lie  in  the  open  left-half  plane  since  every  branch  element 
is  strictly  passive  for  A  sufficiently  large.  Since  the  natural  frequencies  are 
continuous  functions  of  A  [13]  and  fle{30}  >  0  for  A  =  0,  there  exists  some 
A  >  0  for  which  some  natural  frequency  s0  lies  on  the  imaginary  axis.  But 
this  is  ruled  out  by  the  proof  in  part  i)  unless  s0  =  0,  and  the  argument 
in  part  ii)  rules  out  i„  =  0,  since  any  network  solution  at  3„  =  0  consists 
of  zero  branch  voltages  except  for  capacitor  branches,  and  for  A  >  0  each 
capacitor  has  a  conductance  G  in  parallel  with  it.  Since  the  voltage  across 
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G  is  zero  in  such  a  network  solution,  all  branch  voltages  (and  thus  all  branch 
currents)  in  that  solution  must  be  zero,  which  is  a  contradiction  because  a 
natural  frequency  at  s0  would  imply  the  existence  of  a  nonzero  solution. 

Proof  of  Theorem  2 

First  consider  the  special  case  in  which  all  branch  voltages  and  currents 
can  be  zero  in  equilibrium.  By  Tellegen’s  theorem,  for  any  set  of  initial 
conditions  and  any  time  T  >  0, 

/  Y  (vjk(f)  +  TVk(t))ik(t)dt  + 
resistor* 

/  Y  (*>*(*)  +  TVk(t))ik(t)dt  + 
capacitors 

f  Y  (vfc(0  +  rvk(t))ik(t)dt  =  0,  (8) 

J0  cell  impedance* 

where  v  denotes  dv/dt.  The  resistor  co-content  <j>k[v)  is,  for  all  v  in  the 
range  of  fk(i), 

<t>k(v)  =  f  9k(v')dv'  >  0,  (9) 

Jo 

where  gk  is  the  inverse  of  the  function  /*;  note  that  gk  exists  because  fk  is 
monotonically  increasing.  Then  for  resistors, 

[  ( vk(t )  +  rvk(t))ik{t)dt  = 

Jo 

I  vk(t)ik(t)dt  + 

Jo 


-  4>k(vk{ 0))] 


(10a) 


and  using  the  inequality  in  (9),  along  with  r  >  0,  gives 

/  (vj k(t)  +  Tvk(t))ik(t)dt  > 

Jo 

[  vk(t)ik(t)dt  -  r<t>k(vk( 0)) 

Jo 


(10b) 


for  all  resistor  branches.  Similarly  the  capacitor  energy  Ek(q ),  as  a  function 
of  the  charge  q,  is 


£*(?)=  C  vk(q')dq' >  0. 
Jo 


(11) 


Then  for  capacitors, 


/  (t>k(<)  +  Tvk(t))ik(t)dt  = 
Jo 

t  [  vk{t)ik{t)dt  +  . 

Jo 

(£ite(T))  -  £*(,*( 0))], 


and  using  the  inequality  in  (11)  gives 

I  (vk(t)  +  rvk(t))ik(t)dt  > 
Jo 

r  f  vk(t)ik(t)dt  -  Ek(qk(0)) 
Jo 


(12a) 


(12b) 


11 


for  all  capacitor  branches.  And  for  cells,  the  assumption  that  (1  +  rs)Zn(s) 
is  positive- real  (by  the  Popov  condition)  implies  that 

/  (t>n(t)  +  Tvn(t))in(t)dt  >  -En( 0),  (13) 

where  fJn(0)  >  0  is  the  “initial  energy  in  the  Popov-multiplied  cell  impedance” 
at  t  =  0,  a  function  of  the  initial  condition  only.  Using  (10b),  (12b),  and 
(13)  in  (8)  gives 

/  51  vk(t)ik(t)dt  + 

J°  resistors 

r  J  52  vk(t)ik(t)dt  < 

®  capacitors 

£  ’■<sl(^(0))+  £  £,(?,(0))+ 

resistors  capacitors 

£  6.(0).  (14) 

cell  impedances 

But  the  right  side  of  (14)  depends  on  the  initial  conditions  only,  so  that 

/  J2  vk(t)ik(t)dt  + 

JO  T"~ 

retutors 

t  J  52  Vk(t)ik(t)  <  oo.  (15) 

^  capacitors 

For  resistors,  the  inequality  condition  on  fk,  the  zero  equilibrium  branch 
voltage  and  current  assumption,  and  Rmin  >  0  yields  ik  <  R^invkik.  Also, 
for  capacitors  i\  =  Ck(vk) v\  <  CmaxCk(vk)vl  and  Cma*  >  0  so  that  i\  < 
CmaxVkiic .  The  resultant  inequalities  for  resistors  and  capacitors,  along  with 
Rmtn  >  0  and  Cmaz  >  0,  in  (15)  yield  the  result  (3)  for  the  special  case  of 
ik  =  0  for  all  branches: 

/  5Z  **(*)<*<  +  t  J  5]  «*(*)<**  <  00 •  (16) 

0  resistors  0  capacitors 


12 


To  prove  the  result  for  the  general  case  of  a  nonzero  equilibrium  solution,  a 
constant  additive  transformation  on  the  branch  voltage  and  current  wave¬ 
forms  will  result  in  a  network  satisfying  the  special  case  just  proven.  Note 
that  capacitor  branch  currents  vanish  at  equilibrium. 

Proof  of  Theorem  3 

As  in  the  proof  of  Thm.  2,  we  specifically  address  only  the  case  in  which  all 
the  Thevenin  equivalent  cell  voltages  are  zero  and  thus  all  the  branch  volt¬ 
ages  and  currents  are  zero  at  equilibrium.  By  condition  ii),  each  impedance 
Z„(s)  has  a  terminal  connected  to  mn  resistors  and  to  no  other  elements, 
where  0  <  mn  <  M.  If  mn  =  0,  then  the  cell  is  open-circuited;  it  does 
not  affect  the  rest  of  the  circuit.  If  mn  >  1,  then  Zn(s)  is  connected  to  mn 
linear  resistors  of  value  Rmin/2  as  explained  in  Fig.  7.  Let  t,  be  the  branch 
currents  entering  the  resistors  at  the  dashed  boundary  shown  in  Fig.  7d, 
j  =  1,2,  ...,mn,  and  let  Vj  be  the  corresponding  voltages  referenced  to  the 
terminal  of  the  cell  shown  as  ground.  Also  let  vt  and  »,  be  the  voltage 
across  and  current  through  Zn(s),  respectively,  in  the  direction  sense  such 
that 

<«(*)- (17) 

Then 

"At  )  =  <'.(0  +  (%i)i;W.  (is) 

j  =  1,2,  ...,mn.  Using  (17)  and  (18)  gives 

/  £(”;(<)  +  TVj(t))ij(t)dt  =  f  (u,(t)  +  rvt(t))ix(t)dt  + 

Jo  1  Jo 
rT  m>»  I? 

^(£W)( . (t)  +  r  •  j(t))i  (19) 

Jo  J=1  L 

Using  (17),  (19)  cm  be  written  as 

/  £(”;(*)  +  ’’">(<) = 

J0  j=i 
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J0  M<)  +  ri,(t)  +(^^-K‘.(f)  +  ri,(f))]i,(t)<Jt  + 

Jo  ]Stl  2 

fT  .  ijp  t 

J  (20) 

J°  ;=1  2 

Since  m~liM(t)  is  the  mean  of  ij(t)  over  all  j ,  and  i2mm  >  0,  the  integrand  in 
the  second  term  on  the  right  side  of  (20)  is  nonnegative  (as  is  easily  shown 
by  a  standard  quadratic  form),  e.g. 

D 

£(-ip)(*;(<)  -  mnl»*(*))*j(<)  >  0.  (21) 

j- 1  “ 

Also,  (17)  and  (21)  can  be  used  to  show  that 

fT 

L  E  2(*j(0  -  mnl^(0)*i(0^  = 

0 

j=i 

*7*n 

E(<j(0)  -  m;li,(0))ii(0)  >  K,  (22) 

J=1 

where  iv  depends  on  the  initial  conditions  only.  Condition  iii)  in  the  state¬ 
ment  of  the  theorem  and  mn  <  M  mean  that  the  first  integral  on  the  right 
side  of  (20)  is  bounded  below  by  —En( 0),  where  En(0)  is  the  “initial  energy 
in  the  impedance  [Zn(s)  +  A*^](l  +  rs).”  This,  with  (20),  (21),  and  (22), 
show  that 

fT  !>;(*)  +  rvjm^dt  >  Kn(0)  (23) 

J0  >=i 

where  A'n(0)  depends  only  on  the  initial  conditions  at  t  =  0,  for  n  = 
1,2 The  resistor  inequality  f'k(ik)  >  i?mtn  +  e  shows  that  the  non¬ 
linear  resistors  in  Fig.  7c  have  /*(i*)  >  e/2.  Thus  the  circuit  satisfies  the 
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conditions  of  Thm.  2,  except  for  the  form  of  the  cell  impedances;  in  this 
regard,  equation  (23),  summed  over  all  the  cells,  is  used  in  place  of  (13)  for 
the  proof. 
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Figure  Captions 


Figure  1:  The  cell  in  dotted  lines,  a  photoreceptor  and  signal  processor 
circuit  using  two  MOS  wide-range  amplifiers,  realizes  spatial  lateral  inhi¬ 
bition  by  communicating  with  similar  cells  through  a  resistive  grid.  Bias 
adjustments  ensure  that  the  output  impedance  of  amp  is  much  lower 
than  that  of  amp  #2. 

Figure  2:  Interconnection  of  cells  through  a  hexagonal  resistive  grid.  Ground 
connections  are  internal  to  each  cell.  Cells  sue  drawn  as  2-terminal  elements 
with  the  power  supply  and  signal  output  lines  suppressed  to  emphasize  that 
each  is  modelled  as  a  black  box  characterized  by  its  driving-point  impedance 
seen  from  the  grid  terminal.  The  grid  resistors  will  be  nonlinear  by  design 
in  many  such  circuits. 

Figure  3:  Elementary  model  for  an  MOS  amplifier. 

Figure  4:  Simplified  network  topology  for  the  circuit  in  Fig.  1.  The  ca¬ 
pacitor  that  appears  explicitly  in  Fig.  1  has  been  absorbed  into  the  output 
capacitance  of  transamp  #2. 

Figure  5:  Passive  network  with  driving-point  impedance  identical  to  that 
of  the  cell  model  in  Fig.  3  with  the  transamp  modelled  as  in  Fig.  4. 

Figure  6:  Illustration  for  the  proof  of  Theorem  1.  For  each  u  >  0  the  cell 
impedances  Zn(ju)  must  all  lie  below  some  half-space  boundary  lying  in 
the  closed  first  and  third  quadrants.  The  boundary  can  vary  with  u>. 

Figure  7:  a)  Nonlinear  resistor  connected  to  cells  at  nodes  a  and  e.  The 
dashed  lines  emphasize  that  each  cell  is  also  connected  to  other  resistors,  not 
shown,  b)  The  resistor  in  a)  can  be  split  into  a  series  string  of  two  identical 
resistor  pairs,  where  each  pair  consists  of  a  linear  resistor  of  value  Rmin/2 
and  a  nonlinear  resistor.  If  Rmin  is  chosen  to  be  less  than  the  smallest 
value  of  f\i)i  then  the  resulting  nonlinear  resistors  between  nodes  b,  c,  and 
d  will  still  have  strictly  monotone  increasing  v  —  i  curves,  c)  The  model  for 
parasitics  associated  with  the  resistor  in  a)  can  include  capacitors  between 
any  of  the  nodes  6,  c,  d,  and  ground;  it  can  not  include  any  connected  to 
a  or  e.  d)  Each  cell  impedance  can  be  thought  of  as  a  multiterminal  linear 
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FIGURE 


FIGURE 


FIGURE  7a 


FIGURE  7d 


